fiber optic shelf storage system

专利摘要:
a fiber optic shelf storage system includes a shelf that includes a plurality of holes, a plurality of optical fiber filaments, each of the plurality of optical fiber filaments has a first end and a second end, and the the first end is coupled to one of the plurality of holes, a support configured to retain the second ends and expose the end surfaces of the plurality of optical fiber filaments, a first camera configured to capture an image of the end surfaces of the plurality of optical fiber filaments , and a second camera configured to capture an image of one side of one or more products on the shelf. the fiber optic shelf storage system determines a quantity of products on the shelf based on the image captured from the end surfaces of the plurality of fiber optic filaments and the image captured on the side of one or more products on the shelf.
公开号:BR112019021966A2
申请号:R112019021966
申请日:2018-04-18
公开日:2020-05-05
发明作者:Christopher Goss John；Daniel Noble Gregory；Michael Roa Kevin；Steven Meiser Douglas
申请人:Sunrise R&D Holdings, Llc；
IPC主号:

专利说明:

STORAGE SYSTEM IN FIBER OPTIC SHELF CROSS REFERENCE TO RELATED ORDERS [001] This order depends on and claims the priority of Order No. US 15 / 491,096 filed on April 19, 2017, the entire contents of which are incorporated into this document, as title of reference.
TECHNICAL FIELD [002] This disclosure relates to fiber optic shelf storage systems and, more particularly, fiber optic shelf storage systems to determine the number of products and the location of products on the shelves using filaments fiber optics connected to holes in the shelves.
BACKGROUND [003] Counting and tracking the amount of inventory on store shelves is an expensive and time-consuming undertaking in stores. As a large part of the space between the shelves is filled with the product in some configurations, it is necessary to have a solution that occupies a minimum space on the shelf. Some solutions use weight or cameras that view a product to calculate inventory. However, weight-based systems are expensive to deploy. Image-based systems may require images from above the product, which would be infeasible or significantly more expensive to obtain sufficient coverage when there is generally little space between the top of the product and the shelf above the product.
[004] Therefore, systems are needed to automatically determine the number of products on store shelves.
Petition 870190105684, of 10/18/2019, p. 12/166
2/64
SUMMARY [005] In one embodiment, an optical fiber shelf storage system includes a shelf that includes a plurality of holes in an upper shelf surface, a plurality of optical fiber filaments, each of the plurality of optical fiber filaments having a first end and a second end, and the first end being coupled to one of the plurality of holes, a support exposing the end surfaces of the second ends of the plurality of fiber optic filaments, a first camera configured to capture an image of the surfaces terminals of the plurality of optical fiber filaments, and a second camera configured to capture an image of one side of one or more products on the shelf. The fiber optic shelf storage system also includes one or more processors coupled communicatively to the first camera and the second camera, one or more memory components coupled communicatively to one or more processors, and machine-readable instructions stored in one or more components of memory that, when run by one or more processors, causes the fiber optic shelf storage system: determine the number of products on the shelf based on the image captured from the end surfaces of the plurality of fiber optic filaments and the image captured next to one or more products on the shelf.
[006] In another embodiment, a fiber optic shelf storage system includes a first shelf including a first set of holes on the top surface of the first shelf, a second shelf
Petition 870190105684, of 10/18/2019, p. 12/176
3/64 including a second set of holes in the upper surface of the second shelf, a first set of fiber optic filaments having first and second ends, each of the first ends of the first set of fiber optic filaments being coupled to one of the first sets of holes, a second set of optical fiber filaments having first and second ends, each of the first ends of the second set of optical fiber filaments being coupled to one of the second set of holes, a first support configured to retain the second ends of the first set of fiber optic filaments, the first support exposing the end surfaces of the second ends of the first set of optical fiber filaments, a second support configured to retain the second ends of the second set of optical fiber filaments, the second support exposing the terminal surfaces of the second the ends of the second set of optical fiber filaments, a shadow box including a plurality of openings, each of the plurality of openings being configured to receive a support, a first camera inside the shadow box, the first camera configured to capture a image of the end surfaces of the first set of optical fiber filaments and the end surfaces of the second set of optical fiber filaments, one or more processors coupled communicatively to the first camera, one or more memory components coupled communicatively to one or more processors and instructions readable files stored in one or more memory components that, when run
Petition 870190105684, of 10/18/2019, p. 12/186
4/64 by one or more processors, additionally cause the optical fiber shelf storage system to: determine several products on the first shelf and several products on the second shelf, based on the image captured from the end surfaces of the first set of fiber filaments optics and the end surfaces of the second set of optical fiber filaments.
[007] In yet another embodiment, a fiber optic shelf storage system includes a shelf that includes a plurality of holes in an upper surface of the shelf, a plurality of lids integrated into the plurality of holes, a plurality of optical fiber filaments each of the plurality of optical fiber filaments having a first end and a second end, and the first end being detachably coupled to one of the plurality of caps, a support configured to retain the second ends of the plurality of optical fiber filaments , the support exposing the end surfaces of the second ends of the plurality of optical fiber filaments, a first camera configured to capture an image of the end surfaces of the plurality of optical fiber filaments, one or more processors coupled communicatively to the first camera, one or more memory components coupled communicatively to the single single or more machine-readable processors and instructions stored in one or more memory components that, when run by one or more processors, additionally cause the fiber optic shelf storage system to: determine a number of products on the shelf based on the captured image
Petition 870190105684, of 10/18/2019, p. 12/196
5/64 of the end surfaces of the plurality of optical fiber filaments.
[008] These and additional resources provided by the modalities described in this document will be understood more fully in view of the detailed description below, together with the drawings.
BRIEF DESCRIPTION OF THE DRAWINGS [009] The modalities established in the drawings are illustrative and exemplary in nature and are not intended to limit the matter defined by the claims. The following detailed description of the illustrative modalities can be understood when read in conjunction with the following drawings, in which a similar structure is indicated with similar reference numerals and in which:
Figure 1 schematically represents a perspective view of a fiber optic shelf storage system, according to one or more modalities shown and described in the present document;
Figure 2A schematically represents a fiber optic shelf storage system that includes a plurality of optical fiber filaments, according to one or more embodiments shown and described in the present document;
Figure 2B schematically represents an optical fiber shelf storage system that includes a plurality of optical fiber filaments, according to one or more embodiments shown and described in the present document;
Figure 3A schematically represents a plurality of
Petition 870190105684, of 10/18/2019, p. 12/20
6/64 lids integrated in a shelf according to one or more modalities shown and described in this document;
Figure 3B schematically represents a plurality of lids integrated in a shelf according to one or more embodiments shown and described in the present document;
Figure 4 schematically represents the coupling of a support to a shadow box, according to one or more modalities shown and described in the present document;
Figure 5A schematically represents a fiber optic shelf storage system and a second camera, according to one or more modalities shown and described in this document;
Figure 5B represents end surfaces of the plurality of optical fiber filaments coupled to the shelf, according to one or more embodiments shown and described in the present document;
Figure 5C represents an image of the products side on the shelf captured by a second camera, according to one or more modalities shown and described in this document;
Figure 6 represents a fiber optic shelf storage system, according to one or more modalities shown and described in this document;
Figure 7 represents a fiber optic shelf storage system including lighting sources, according to one or more modalities shown and described in this document;
Figure 8 represents a perspective view of a
Petition 870190105684, of 10/18/2019, p. 12/21
7/64 optical fiber shelf storage system including a plurality of display units, according to one or more modalities shown and described in the present document;
Figure 9 represents a fiber optic shelf storage system including a plurality of display units, according to one or more embodiments shown and described in the present document;
Figure 10 schematically represents a computer network for controlling a shadow box, a second camera, and shelf display units, according to one or more modalities shown and described in the present document;
Figure 11 schematically represents a computer network architecture for controlling a shadow box, a second camera, and shelf display units, according to one or more of the modalities shown and described in this document;
Figure 12 schematically represents a company computing system, according to one or more modalities shown and described in this document;
Figure 13 schematically represents a store computing system, according to one or more modalities shown and described in the present document;
Figure 14 illustrates graphically a computer-implemented method for determining whether holes in a shelf are blocked from light, according to one or more modalities shown and described in this document;
Figure 15 schematically represents the conversion of an image of optical fiber filament end surfaces
Petition 870190105684, of 10/18/2019, p. 12/22
8/64 in pixel values and the determination of whether the holes in a shelf are blocked from light, according to one or more modalities shown and described in this document;
Figure 16 illustrates graphically a computer-implemented method for determining the number of products on the shelf, according to one or more modalities shown and described in this document;
Figures 17A and 17B represent a product on a shelf and the number of holes blocked by the product, according to one or more embodiments shown and described in this document;
Figures 17C and 17D represent an object on a shelf and the number of holes blocked by the object, according to one or more modalities shown and described in this document;
Figure 18 illustrates graphically a computer-implemented method for determining the number of objects on the shelf, according to one or more modalities shown and described in this document;
Figure 19 represents images of the products side on a shelf captured by a second camera, according to one or more modalities shown and described in this document;
Figure 20 illustrates graphically the method implanted by computer to determine an orientation of a product on a shelf according to one or more modalities shown and described in the present document;
Figures 21A, 21B and 21C represent schematically the determination of a product orientation in a
Petition 870190105684, of 10/18/2019, p. 12/23
9/64 shelf, according to one or more modalities shown and described in this document;
Figure 22 illustrates graphically a computer-implemented method to determine whether products should be stored on a shelf, according to one or more modalities shown and described in this document;
Figure 23 illustrates graphically a computer-implemented method to determine a period of time that a product has been on a shelf, according to one or more modalities shown and described in this document; and
Figure 24 illustrates graphically the method implemented by computer to detect theft activities, according to one or more modalities shown and described in this document.
DETAILED DESCRIPTION [010] Referring generally to the figures, the modalities described in this document are directed to the fiber optic shelf storage system to determine the number of products on a shelf, that is, quantities of inventory and / or locations of products on the shelf. A fiber optic shelf storage system includes a shelf that includes a plurality of holes in the top surface of the shelf, a plurality of optical fiber filaments, each of the plurality of optical fiber filaments having a first end and a second end, the first end being coupled to one of the plurality of holes, a support exposing terminal surfaces of the plurality of optical fiber filaments, a first camera configured to capture an image of the terminal surfaces of the
Petition 870190105684, of 10/18/2019, p. 12/24
10/64 second ends of the plurality of optical fiber filaments and a second camera configured to capture an image of one side of one or more products on the shelf. The fiber optic shelf storage system determines the number of products on the shelf based on the image captured from the end surfaces of the second ends of the plurality of fiber optic filaments and the image captured on the side of one or more products on the shelf. Such systems allow stores to accurately determine inventory quantities in real time, check the displayed orientation of products on the shelves, facilitate the replenishment of products, warning that there is little stock or out of stock, determine products that must expire or deteriorate, and prevent theft activities. Modalities of the systems for determining the number of products on a shelf using fiber optic filaments will be described in more detail in this document with reference to the accompanying figures.
[011] With reference to Figure 1, a perspective view of a fiber optic shelf storage system 100, according to one or more modalities is shown schematically. The fiber optic shelf storage system 100 includes a shelf 101 that includes an upper surface 102, where a plurality of holes 104 are located. The shelf 101 can be fixed to a wall 105. In the embodiments, the shelf 101 is coupled perpendicularly to the wall 105. The plurality of holes 104 can be covered by a transparent material, so that ambient light can pass through the holes 104. In some embodiments, the plurality of holes 104 can
Petition 870190105684, of 10/18/2019, p. 12/25
11/64 be covered by a translucent material that can add color to the light that passes through the plurality of holes 104.
[012] Figure 2A is a perspective view of a fiber optic shelf storage system 100 according to one or more embodiments. In Figure 2A, shelf 101 includes a plurality of lids 106 integrated into the plurality of holes 104, respectively. The shelf 101 can be dl thick. The plurality of caps 106 may consist of light transmitting material. The detailed structure of the plurality of caps 106 will be described further with reference to Figure 2B. A plurality of optical fiber filaments 108 are coupled to the plurality of caps 106. Specifically, a first end 108a of an optical fiber filament 108 can be detachably coupled to one of the plurality of caps 106, as shown in Figure 2A . Each of the plurality of caps 106 is optically coupled to each of the optical fiber filaments 108.
[013] Each of the second ends 108b of the plurality of optical fiber filaments 108 is attached to a support 210 so that the support 210 maintains an array of end surfaces 212 of optical fiber filaments. The end surfaces 212 of the optical fiber filaments 108 are optically connected to the plurality of holes 104. For example, a terminal surface 212a of the optical fiber filament 108 is optically connected to the orifice 104a, so that a light entering the orifice 104a travels through along the fiber optic filament 108 and illuminate the end surface 212a of the fiber optic filament 108. Thus, when ambient light enters the orifice 104a, the end surface
Petition 870190105684, of 10/18/2019, p. 12/26
12/64
212a lights up. Likewise, a terminal surface 212b of optical fiber filament 108 is optically connected to orifice 104b, so that a light entering orifice 104b travels along optical fiber filament 108 and illuminates the end surface 212b of the fiber filament. optics. Thus, when ambient light enters the orifice 104b, the end surface 212b illuminates. In contrast, when the hole 104a is blocked by a non-transparent object on the top surface 102 of the shelf 101, the end surface 212a does not illuminate.
[014] In another embodiment, the optical fiber filaments 108 can be directly coupled to the plurality of holes 104 without any intermediate cover 106. In some embodiment, a plurality of covers similar to the plurality of covers 106 of the shelf 101 can be integrated into the support 210, and the second ends 108b of the plurality of optical fiber filaments 108 are detachably attachable to the covers integrated in the holder 210. The holder 210 can expose end surfaces of the plurality of covers that are coupled to the optical fiber filaments 108.
[015] In some embodiments, shelf 101 may include a weight sensor 107 to detect the weight of objects placed on the top surface 102. Weight sensor 107 transmits weight information about products on shelf 101 to a store computing system. , which will be described below with reference to Figure 10 [016] Figure 2B is a perspective view of a fiber optic shelf storage system 100 according to another embodiment. In Figure 2B, a carpet 103
Petition 870190105684, of 10/18/2019, p. 12/27
13/64 is used in the fiber optic shelf storage system 100. The d2 thickness of the carpet 103 is less than the dl thickness of the shelf 101. The carpet 103 can be a flexible carpet, such as a PVC carpet, or made of other materials. Similar to shelf 101 in Figure 2A, carpet 103 includes a plurality of holes 104. Carpet 103 includes a plurality of lids 106 integrated into the plurality of holes 104, respectively. The plurality of optical fiber filaments 108 are incorporated within the carpet 103 and exposed on one side of the carpet 103. The plurality of optical fiber filaments 108 is coupled to the plurality of caps 106. Specifically, a first end 108a of a fiber filament optic 108 is detachably attachable to one of the plurality of caps 106, as shown in Figure 2A. Each of the plurality of caps 106 is optically coupled to each of the optical fiber filaments 108. Each of the second ends 108b of the plurality of optical fiber filaments 108 is attached to the support 210, and the support 210 exposes an array of end surfaces 212 of the plurality of optical fiber filaments 108. The end surfaces 212 of the plurality of optical fiber filaments 108 are optically connected to the plurality of holes 104. Thus, when ambient light enters the holes 104, the end surfaces 212 are illuminated. In contrast, when the holes 104 are blocked by a non-transparent object on the upper surface 102, the end surfaces 212 are not illuminated. In another embodiment, the optical fiber filaments 108 can be directly coupled to the plurality of holes 104 without any intermediate cap 106.
Petition 870190105684, of 10/18/2019, p. 12/28
14/64 [017] Figures 3A and 3B represent the structure of the plurality of caps 106 according to one or more embodiments. In Figure 3A, the plurality of caps 106 is integrated into the shelf 101. Each of the optical fiber filaments 108 is detachably attachable to each of the plurality of caps 106. In the embodiments, the plurality of caps 106 is cone-shaped , so that the light entering the caps 106 can converge on the optical fiber filaments 108. In some embodiments, the plurality of caps 106 is integrated between two layers of the carpet 103, as shown in Figure 3B. An additional layer (not shown in Figure 3B) of the carpet 103 can form the bottom of the carpet 103, so that the optical fiber filaments 108 are incorporated into the carpet 103. Each of the optical fiber filaments 108 is detachably attachable to each of the plurality of caps 106. The structure of caps 106 is not limited to those described in Figures 3A and 3B, and may be in a different shape, for example, a cylindrical shape, a rectangular parallelepiped, etc. In some embodiments, the mat 103 may be a single plate retaining the plurality of caps 106 and the plurality of optical fibers the filaments 108 may be incorporated within the mat 103.
[018] Figure 4 represents the coupling of the support 210 to a shadow box 310, according to one or more modalities shown and described in the present document. As described with reference to Figure 2, each of the second ends 108b of the plurality of optical fiber filaments 108 is attached to the support 210, and the support 210 exposes the end surfaces 212 of the optical fiber filament 108. The support 210 can be inserted in an opening
Petition 870190105684, of 10/18/2019, p. 12/29
15/64
324 of the shadow box 310. The holder 210 includes retention mechanisms 220 that securely fix the holder 210 in the opening 324 of the shadow box 310. A camera 320 is inside the shadow box 310 and configured to capture an image of the matrix of the terminal surfaces 212 of the plurality of optical fiber filaments 108. The shadow box 310 may be made of materials that prevent external illumination from entering the shadow box 310, except for the light of the plurality of optical fiber filaments 108, so that camera 320 can accurately capture light from terminal surfaces 212. The image captured by camera 320 can be transmitted to a store computer system, which will be described below with reference to Figure 10. In some embodiments, camera 320 can process the captured image to obtain data (for example, pixel values) and transmit the data to the store computer system. In some embodiments, the camera 320 captures visual characteristics (for example, optical intensity, color spectrum, light density) of the terminal surfaces 212 of the plurality of optical fiber filaments 108. The visual characteristic can be transmitted to the store computer system which can determine whether a product on shelf 101 is expired or deteriorated based on the visual characteristic. For example, the product's projected color matrix can be used to determine whether the product is past due or deteriorated.
[019] In the modalities, the shadow box 310 includes a light source 322 that directs the light towards the support 210. The light source 322 can be any light source, for example, a LED, fluorescent,
Petition 870190105684, of 10/18/2019, p. 12/30
16/64 laser, etc. The light source 322 can emit several colors of light. The light from the light source 322 enters the terminal surfaces 212, travels through the optical fiber filaments 108 and illuminates the plurality of holes 104. The light source 322 can be communicatively coupled to the store computer system and receive an instruction to illuminate the terminal surfaces 212 of the computing system, the details of which will be described below with reference to Figure 10. The light source 322 can project light on various supports or it can be mobile to reach certain supports. In some embodiments, the shadow box 310 may include a plurality of light sources. Each of the plurality of light sources can direct the light to one of the plurality of supports.
[020] Figure 5A represents a fiber optic shelf storage system 500 according to one or more modalities. The fiber optic shelf storage system 500 includes shelf 101 and a second camera 530. Shelf 101 is attached to wall 105. As described with reference to Figure 2A, shelf 101 includes the plurality of holes 104 in its upper surface. 102 and the plurality of optical fiber filaments 108 (not shown in Figure 5A) that are coupled to the shadow box 310 (not shown in Figure 5A). The second camera 530 may be located on the other side of shelf 101 (for example, located on the + x side of shelf 101) and pointed to shelf 101 (for example, pointing in the x direction). Camera 530 can capture one side of one or more products 510 on shelf 101 (i.e., an image of the yz plane). One or more 510 products are placed on the top surface
Petition 870190105684, of 10/18/2019, p. 12/31
17/64
102 on shelf 101. Ambient light 520, like store lights, illuminates holes 104 on shelf 101. For example, ambient light 520 enters some of the holes 104 on the shelf in the -z direction, travels through optical fiber filaments 108 and reaches the shadow box 310. Other holes 104 on the shelf 101 are blocked by products 510, so that ambient light 520 cannot travel through the blocked holes 104.
[021] Figure 5B illustrates an array of end surfaces 212 of optical fiber filaments 108 optically connected to the plurality of holes 104 on shelf 101 in Figure 5A. A first set 222 of the end surfaces 212 is illuminated by ambient light 520. In contrast, a second set 224 of the end surfaces 212 is dark due to the fact that the corresponding holes 104 are blocked by the products 510. The camera 320 in the shadow box 310 can capture the array of terminal surfaces 212 and send the captured image to the store's computing system to determine inventory quantities on shelf 101. Figure 5C illustrates an image captured by the second camera 530. The image includes a side of five products 510 on shelf 101. The image captured by the second camera 530 can also be transmitted to the store computer system to determine the number of products 510 on shelf 101.
[022] Figure 6 is a perspective view of a 600 optical fiber shelf storage system according to another embodiment. The fiber optic shelf storage system 600 includes a plurality of shelves 101. The plurality of shelves 101 is coupled
Petition 870190105684, of 10/18/2019, p. 12/32
18/64 to wall 105. Each of the plurality of shelves 101 includes the plurality of holes 104 in their upper surface 102. As described with reference to Figure 2A above, for each of the plurality of shelves 101, the first ends of the plurality of optical fiber filaments 108 are optically coupled to the plurality of caps 106 integrated in the upper surface 102 and the second ends of the plurality of optical fiber filaments 108 are fixed by the supports, for example, supports 210a, 210b and 210f. The supports 210a, 210b and 210f expose the end surfaces 212 of the collected optical fiber filaments 108. The shadow box 310 includes a plurality of openings 324a, 324b, 324c, 324d, 324e and 324f. Each of the openings 324a, 324b, 324c, 324d, 324e and 324f can receive one of the supports. For example, support 210a, 210b and 210f can be inserted into openings 324a, 324b and 324f. Shadow box 310 includes camera 320 inside. Camera 320 can capture a matrix image of terminal surfaces 212 of supports 210a, 210b and 210f at the same time. Thus, the captured image includes inventory information on more than one shelf. Although Figure 6 illustrates that shadow box 310 includes six openings, the number of openings is not limited to it.
[023] Figure 7 represents a fiber optic shelf storage system 700 according to one or more modalities. The fiber optic shelf storage system 700 includes a plurality of shelves 101. The plurality of shelves 101 is coupled to the wall 105. Each of the plurality of shelves 101 includes the plurality of holes 104 in their upper surface 102a,
Petition 870190105684, of 10/18/2019, p. 12/33
19/64
102b, 102c or 102d. Ambient light 710, like store lights, illuminates holes 104 of the plurality of shelves 101. However, ambient light 710 may not uniformly illuminate each of the plurality of shelves 101 due to obstacles, difference in distance from the light source, etc. In this embodiment, shelves 101 include light sources 720a, 720b and 720c at the bottom of shelves 101. Each of the light sources 720a, 720b and 720c illuminates the upper surface of shelf 101 below each of the light sources 720a, 720b and 720c. For example, light source 720a illuminates upper surface 102b and product 722, light source 720b illuminates upper surface 102c and product 724 and light source 720c illuminates upper surface 102d and product 726. Intensity of the light reaching the upper surfaces 102b, 102c and 102d can be substantially the same because the lumen of the lighting sources 720a, 720b and 720c is substantially the same.
[024] Now, with reference to Figure 8, a perspective view of a modular shelf storage system 800 including a first shelf storage module 110, a second shelf storage module 120, and a plurality of interface amounts 130 is schematically represented. Each of the first shelf storage module 110 and the second shelf storage module 120 includes a base 112, a backplane 114, a plurality of shelves 101 and a plurality of display units 118. Each of the plurality of shelves 101 includes the plurality of holes 104, as described with reference
Petition 870190105684, of 10/18/2019, p. 12/36
20/64 to Figure 1. The posterior plane 114 is generally planar and extends substantially perpendicularly from the base 112. The plurality of shelves 101 are attached to the plurality of uprights in interface 130, each of which includes a plurality of openings through which corresponding projections of the plurality of shelves 101 can be inserted to mount the plurality of shelves 101 to the shelf storage modules. The plurality of shelves 101 extends substantially perpendicularly from the rear plane 114 in a direction that is substantially parallel to the base 112. The assembly of the shelf storage modules and the interface uprights 130 supports the plurality of shelves 101 on which products can be placed. The plurality of display units 118 extend under the plurality of shelves 101 and are operable to display information to a person close to the shelf storage modules, such as information pertaining to products in the plurality of shelves 101, useful information for stocking products in the plurality of shelves 101, information useful for retrieving products from the plurality of shelves 101, and a variety of additional information, as will be described in detail below.
[025] Still with reference to Figure 8, in some embodiments, each of the plurality of display units 118 is powered by an Ethernet connection or via the posterior plane 114, as described in US Patent Application No. 13 / 734,443, titled DISPLAY SHELF MODULES WITH PROJECTORS FOR DISPLAYING PRODUCT INFORMATION AND MODULAR SHELVING SYSTEMS COMPRISING THE SAME, whose
Petition 870190105684, of 10/18/2019, p. 12/35
21/64 totality is incorporated by reference to this document. In other embodiments, each of the plurality of display units 118 is enhanced by a power distribution system. In some embodiments, the plurality of display units 118 is enhanced in another way, such as by means of batteries, or the like.
[026] Still referring to Figure 8, in some embodiments, each of the plurality of display units 118 includes a projector unit and a display screen, as described in US Patent Application No. 13 / 734,443, entitled DISPLAY SHELF MODULES WITH PROJECTORS FOR DISPLAYING PRODUCT INFORMATION AND MODULAR SHELVING SYSTEMS COMPRISING THE SAME, the entirety of which is incorporated by way of reference in this document. In other embodiments, one or more of the plurality of display units 118 includes an enhanced display screen, such as a TFT screen, an LCD screen, or the like. In some embodiments, the modular shelf storage system 800 may include one or more additional input or output components, such as a microphone (for example, to receive voice input from a consumer), a camera, a barcode reader , a speaker, or the like.
[027] Figure 9 represents a 900 fiber optic shelf storage system according to one or more modalities. The fiber optic shelf storage system 900 includes a plurality of shelves 101. The plurality of shelves 101 is coupled to a shelf storage module 920. Each of the plurality of
Petition 870190105684, of 10/18/2019, p. 12/36
22/64 shelves 101 includes a plurality of holes 104 in their upper surface 102a, 102b, 102c, 102d or 102e. Ambient light 930, like store light, illuminates holes 104 of the plurality of shelves 101. However, ambient light 930 may not uniformly illuminate each of the plurality of shelves 101 due to obstacles, difference in distance from the light source , etc.
[028] In this mode, the plurality of display units 118a, 118b, 118c and 118d directs the light in the (-) x direction. Shelves 101 include optical elements 910a, 910b, 910c, 910d at the bottom of shelves 101. Optical elements 910a, 910b, 910c and 910d can be light reflecting elements, for example, mirrors, which direct the light 902 emitted by the plurality of display units 118a, 118b, 118c and 118d towards the upper surfaces 102b, 102c, 102d, and 102e, so that the upper surfaces 102b, 102c, 102d and 102e are substantially uniformly illuminated by light 902. In other embodiments, shelves 101 do not include optical elements 910a, 910b, 910c and 910d at the bottom of shelves 101 and the plurality of display units 118a, 118b, 118c and 118d directs the lights in one direction towards the upper surfaces 102b, 102c, 102d and 102e, respectively.
[029] Now, with reference to Figure 10, a modality of a computer network 1000 to control the shadow box 310 and to determine the quantities of stock on the shelves is represented schematically. In this modality, the computer network 1000 includes a company computer system 300, a company computer network
Petition 870190105684, of 10/18/2019, p. 37/126
23/64
215, a store computing system 400, a store computing network 225, a device associated with resale 230, a personal assistant and connecting device 240, a mobile computing device 250, the plurality of display units 118, a shadow box 310, and the second camera 530.
[030] Still with reference to Figure 10, the computing network 1000 includes the computing network of company 215 for communicatively coupling the computing system of company 300 and the computing system of store 400 so that data can be exchanged between the company computing system 300 and store computing system 400. Company computing network 215 can include one or more computer networks (for example, a wide area network, a personal area network, or an area network local network), one or more cellular networks, one or more satellite networks or combinations thereof. Consequently, each of a company computing system 300 and the store computing system 400 can be communicatively coupled to the company computing network 215 through a wide area network, through a local area network, for example. through a personal area network, through a cellular network, through a satellite network or the like. Suitable wide area networks may include wired or wireless telecommunications networks that transmit information via coaxial cables, fiber optic cables, radio frequency transmission or the like. Suitable local area networks may include wired and / or wireless Ethernet technologies, such as wireless fidelity (Wi-Fi). Suitable personal area networks can include technologies
Petition 870190105684, of 10/18/2019, p. 12/38
24/64 wireless such as IrDA, Bluetooth, USB Wireless, ZWave, ZigBee and / or other near field communication protocols. Suitable personal area networks can similarly include wireless computer buses, such as USB and FireWire. Suitable cellular networks include, but are not limited to, technologies such as LTE, WiMAX, UMTS, CDMA and GSM.
[031] Still with reference to Figure 10, the company computing network 215 communicatively couples the company computing system 300 and the store computing system 400 so that data can be exchanged between the systems. In some embodiments, the company computing system 300 stores company data and interacts with a plurality of store computing systems associated with a plurality of stores. For example, company computing system 300 may be a central computing system operated by a grocery chain owner or another reseller who owns a plurality of stores to sell products. Each of the plurality of store computing systems can be associated with an affiliated store, owned or operated by the grocery chain or another reseller. Each of the plurality of store computing systems can receive information from the company computing system 300 and uses the data received, along with other input to the store computing system 400 by devices located in the store, to make interface and interact with any number of electronic components (for example, shadow boxes, cameras, point of sale devices, shelf displays, lighting systems, associated devices
Petition 870190105684, of 10/18/2019, p. 39/126
25/64 resale, personal assistant and connecting devices, etc.) in the store.
[032] Still referring to Figure 10, the company computing system 300 stores company data for distribution to a plurality of store computing systems, such as the store computing system 400. For example, the computer computing system company 300 can store inventory quantities that belong to products on the shelves, product data that belongs to products to be sold in one or more store locations, price data that belongs to products to be sold in one or more store locations, planogram data pertaining to product placement on shelves, label data to be displayed on shelf display units in one or more store locations, multimedia content (for example, pictures, video, sound or the like) and the like . The enterprise computing system 300 can facilitate interaction and control of shadow boxes 310, second cameras 530 and the plurality of display units 118 of the modular shelf storage system, as will be described below. The additional components and functionality of the enterprise computing system 300 will be described with reference to Figure 12 below.
[033] Still referring to Figure 10, the store computing system 400 can receive information from the company computing system 300 and uses the data received, along with other data entry to the store computing system 400 by devices. located in the store, to interface and interact with any number of
Petition 870190105684, of 10/18/2019, p. 40/126
26/64 electronic components (for example, cameras, point of sale devices, shelf displays, lighting systems, associated retail devices, personal assistant and connecting devices, etc.) in the store. The store computing system 400 can also facilitate the interaction and control of the shelves 101 and the plurality of display units 118 of the modular shelf storage system, as will be described below. The additional components and functionality of the 400 store computing system will be described with reference to Figure 13 below.
[034] Still with reference to Figure 10, each of a company computing system 300 and the store computing system 400 can be deployed as one or more computing devices, such as, but without limitation, server computers, computers personal devices, mobile computing devices and the like. In addition, although each of a company 300 computer system and store 400 computer system is depicted in Figure 10 as a single piece of hardware, the modalities are not limited to this. For example, in some embodiments, the company computing system 300, the store computing system 400, or both the company computing system 300 and the store computing system 400 can be deployed as a plurality of computing devices interconnected by a network.
[035] Still referring to Figure 10, the computing network 1000 includes the store computing network 225 to connect the store computing system 400 to the device associated with the resale 230, the personal assistant and the connecting device 240, communicatively. the device
Petition 870190105684, of 10/18/2019, p. 41/126
27/64 mobile computing 250, and the plurality of display units 118, so that data can be exchanged between components. The store computing network 225 may include one or more computer networks (for example, a wide area network, a personal area network or a local area network), one or more cellular networks, one or more network networks satellite or combinations thereof. Consequently, each of a device associated with resale 230, the personal assistant and the connecting device 240, the mobile computing device 250, the shadow box 310, the second camera 530 and the plurality of display units 118 can be coupled communicatively to the store computing network 225 through a wide area network, through a local area network, through a personal area network, through a cellular network, through a satellite network or similar. Suitable wide area networks may include wired or wireless telecommunications networks that transmit information via coaxial cables, fiber optic cables, radio frequency transmission or the like. Suitable local area networks may include wired and / or wireless Ethernet technologies, such as wireless fidelity (Wi-Fi). Suitable personal area networks may include wireless technologies such as IrDA, Bluetooth, USB Wireless, Z-Wave, ZigBee and / or other near-field communication protocols. Suitable personal area networks can similarly include wireless computer buses, such as USB and FireWire. Suitable cellular networks include, but are not limited to, technologies such as LTE, WiMAX, UMTS, CDMA and GSM.
[036] Still with reference to Figure 10, the network of
Petition 870190105684, of 10/18/2019, p. 42/126
28/64 store computing 225 communicates the store computing system 400, the device associated with the resale 230, the personal assistant and the connecting device 240, the mobile computing device 250, the shadow box 310, the second camera 530 and the plurality of display units 118 so that data can be exchanged between network components. The store computing system 400 can receive data and provide data for the device associated with resale 230, the personal assistant and the connecting device 240, the mobile computing device 250, the shadow box 310, the second camera 530 and the plurality of display units 118.
[037] Still with reference to Figure 10, in the modalities, the device associated with resale 230 is a mobile computing device that can be used by a resale associate in a store to assist in the performance of a variety of functions, such as refueling. shelves, redefining planograms, scanning product SKUs, retrieving customer orders and the like. The device associated with resale 230 is a computing device that includes a processor, a data storage component, a non-transitory memory component, an input / output hardware, a network interface hardware and a local interface. The processor of the device associated with retail 230 includes a processing component configured to receive and execute instructions from the data storage component of the memory component. The memory component of the device associated with resale 230 can be configured as a computer-readable volatile and / or non-volatile medium and, as such, may include
Petition 870190105684, of 10/18/2019, p. 43/126
29/64 random access memory (including SRAM, DRAM and / or other types of random access memory), flash memory, records, compact discs (CD), digital versatile discs (DVD) and / or other types of storage components . The data storage device or memory component can be configured to store logic that causes the device associated with resale 230 to perform the functions described in this document when performed by the processor. The input / output hardware of the device associated with resale 230 may include a display device (for example, a touch screen, an LCD screen, a plasma screen, a TFT screen or the like), an input device by touch (for example, a numeric keypad, a button, a keyboard, a mouse or similar), a camera, a barcode reader, a microphone, a speaker or the like, to receive, send and / or present data. The network interface hardware of the device associated with resale 230 can include any wired and wireless network hardware, such as a modem, LAN port, wireless loyalty card (Wi-Fi), WiMax card, communications hardware mobile, and / or other hardware to communicate with the store 225 computing network or other devices. The local interface of the device associated with resale 230 can be implemented as a bus or other interface to facilitate communication between the components of the device associated with resale 230. Although Figure 10 represents only a single device associated with resale 230, some modalities may include a plurality of associated resale devices, each of which can be ported and used by a different resale associate.
Petition 870190105684, of 10/18/2019, p. 44/126
30/64 [038] Still referring to Figure 10, the personal assistant and the connecting device 240 is a mobile computing device that can be used by a shopper in a store to perform a variety of functions, such as scanning and paying for products, access shopping lists, or similar. The personal assistant and the connecting device 240 is a computing device that includes a processor, a data storage component, a non-transitory memory component, an input / output hardware, a network interface hardware and a local interface . The personal assistant processor and connector 240 include a processing component configured to receive and execute instructions from the data component of the memory component. The memory component of the personal assistant and the connection device 240 can be configured as a computer-readable volatile and / or non-volatile medium and, as such, may include random access memory (including SRAM, DRAM and / or other types of memory) random access), flash memory, registers, compact discs (CD), digital versatile discs (DVD) and / or other types of storage components. The data storage device or the memory component can be configured to store logic that causes the personal assistant and the connecting device 240 to perform the functions described in this document when performed by the processor. The input / output hardware of the personal assistant and the connecting device 240 may include a display device (for example, a touch screen, an LCD screen, a plasma screen, a TFT screen or the like), a touch input device (for example,
Petition 870190105684, of 10/18/2019, p. 45/126
31/64 example, a numeric keypad, a button, a keyboard, a mouse or similar), a camera, a barcode reader, a microphone, a speaker or the like, to receive, send and / or present data . The network interface hardware of the personal assistant and connecting device 240 can include any wired and wireless network hardware, such as a modem, LAN port, wireless loyalty card (Wi-Fi), WiMax card, mobile communications hardware, and / or other hardware to communicate with the store 225 computing network or other devices. The local interface of the personal assistant and the connecting device 240 can be implemented as a bus or other interface to facilitate communication between the components of the personal assistant and the connecting device 240. Although Figure 10 represents only a single personal assistant and device connection device 240, some embodiments may include a plurality of personal assistant and connection devices, each of which can be carried and used by a different customer.
[039] Still with reference to Figure 10, the mobile computing device 250 can be a mobile phone, a smart phone, a tablet-type computer, a personal digital assistant, a dedicated mobile media player, a mobile personal computer, a laptop-type computer and / or any other mobile device that includes computing components. In some embodiments, the mobile computing device 250 may be used by a resale associate (for example, when a resale associate uses the mobile computing device 250 to perform associated functions instead of the device associated with resale 230).
Petition 870190105684, of 10/18/2019, p. 46/126
32/64
In some embodiments, the mobile computing device 250 may be used by a customer (for example, when a customer uses the mobile computing device 250 instead of the personal assistant and the connecting device 240 while making a purchase). In some embodiments, the mobile computing device 250 can be used by a retail associate or customer in addition to the device associated with resale 230 or the personal assistant and the connecting device 240. The mobile computing device 250 is a computing device that includes a processor, a data storage component, a non-transitory memory component, an input / output hardware, a network interface hardware and a local interface. The processor of the mobile computing device 250 includes a processing component configured to receive and execute instructions from the data storage component of the memory component. The memory component of the mobile computing device 250 may be configured as a volatile and / or non-volatile computer readable medium and, as such, may include random access memory (including SRAM, DRAM and / or other types of random access memory) ), flash memory, records, compact discs (CD), digital versatile discs (DVD) and / or other types of storage components. The data storage device or memory component can be configured to store logic that causes the mobile computing device 250 to perform the functions described in this document when performed by the processor. The input / output hardware of the mobile computing device 250 may include a display device (for example, a
Petition 870190105684, of 10/18/2019, p. 47/126
33/64 touch, an LCD screen, a plasma screen, a TFT screen or the like), a touch input device (for example, a numeric keypad, a button, a keyboard, a mouse or similar), a camera, barcode reader, microphone, speaker or similar, to receive, send and / or present data. The network interface hardware of the mobile computing device 250 can include any wired and wireless network hardware, such as a modem, LAN port, wireless loyalty card (Wi-Fi), WiMax card, communications hardware mobile, and / or other hardware to communicate with the store 225 computing network or other devices. The local interface of the mobile computing device 250 can be implemented as a bus or other interface to facilitate communication between the components of the mobile computing device 250. Although Figure 10 depicts only a single mobile computing device 250, some modalities include a plurality of mobile computing devices, each of which is communicatively coupled to the store computing system 400 over the store computing network 225.
[040] Although the computing network 1000 represented in Figure 10 includes both the company computing network 215 and the store computing network 225, it should be understood that, in other modalities, the company computing system 300, the system store computing device 400, the device associated with resale 230, the personal assistant and the connecting device 240, the mobile computing device 250, the shadow box, the second camera 530 and the plurality of display units 118, can be communicatively coupled by a single computer network, or
Petition 870190105684, of 10/18/2019, p. 48/126
34/64 by additional computer networks other than company computer network 215 and store computer network 225.
[041] Now, with reference to Figure 11, an architecture of an 1100 computing network is represented schematically. The computing network 1100 includes the enterprise computing system 300, the store computing system 400, the device associated with the resale 230, the personal assistant and the connecting device 240, the plurality of display units 118, the shadow 310, the second camera 530, a zooter server 262, a communication port server 264, a scan-bag-go server 266 and an associated task manager server 268. Each one of a server zooter 262, communication port server 264, scanbag-go server 266 and associated task manager server 268 includes a processor, a data storage component, a non-transitory memory component, an input / output, a network interface hardware and a local interface. Each of the components depicted in Figure 11 is interconnected by one or more computer networks, which are not portrayed separately. The associated task manager server 268 relays information between the device associated with the retailer 230 and the store computing system 400. The scan-bag-go server 266 relays information between the personal assistant and the connecting device 240 and the system store computing server 400. Communication port server 264 relays information between the associated task manager server 268, the scan-bag-go server 266 and the zooter server 262.
Petition 870190105684, of 10/18/2019, p. 49/126
35/64 zooter server 262 relays information between the communication port server 264, the plurality of display units 118, the shadow box 310, the personal assistant and the connecting device 240 and the device associated with the resale 230. The architecture shown in Figure 11 does not limit the modalities described in this document. Other architectures may not include one or more of the components depicted, such as modalities that do not include one or more of the intermediate components (for example, the associated task manager server 268, the scan-bag-go server 266, the port server 264 or zooter server 262).
[042] Figure 12 represents additional details in relation to the corporate computing system 300 of Figure 10. In some embodiments, the corporate computing system 300 can be configured as a general purpose computer with the hardware, software and / or requested firmware. In some embodiments, the enterprise computing system 300 can be configured as a special purpose computer designed specifically to perform the functionality described in this document.
[043] As shown in Figure 12, the enterprise computing system 300 includes a processor 330, an input / output hardware 332, a network interface hardware 334, a data storage component 336 and a non-memory component transient 340. Memory component 340 may be configured as a computer-readable volatile and / or non-volatile medium and, as such, may include random access memory (including SRAM, DRAM and / or other types of random access memory), flash memory,
Petition 870190105684, of 10/18/2019, p. 50/126
36/64 registers, compact discs (CD), digital versatile discs (DVD) and / or other types of storage components. Additionally, memory component 340 can be configured to store company panel logic 341, company system integration logic 342, store integration logic 343, file transfer logic 344, company communication port logic 345 and operational logic 346 (each of which can be embedded as a computer program, firmware or hardware, as an example). A local interface 350 is also included in Figure 12 and can be implemented as a bus or other interface to facilitate communication between the components of the enterprise computing system 300.
[044] Still referring to Figure 12, processor 330 may include any processing component configured to receive and execute instructions (such as from data storage component 336 and / or memory component 340). Input / output hardware 332 can include a monitor, keyboard, mouse, printer, camera, microphone, speaker, touch screen and / or other device for receiving, sending and / or presenting Dice. The network interface hardware 334 can include any wired and wireless network hardware, such as a modem, a LAN port, a wireless loyalty card (Wi-Fi), a WiMax card, mobile communications hardware and / or other hardware to communicate with other networks (for example, company 215 computing network) and / or devices.
[045] The data storage component 336 can reside local and / or remote in relation to the computing system
Petition 870190105684, of 10/18/2019, p. 51/126
37/64 of company 300 and can be configured to store one or more parts of the data for access by the company 300 computer system and / or other components. As shown in Figure 12, data storage component 336 can store a company data repository 336a, which can include product data pertaining to products to be sold at one or more store locations, price data pertaining to products to be sold at one or more store locations, planogram data pertaining to product placement on shelves, label data to be displayed on shelf display units at one or more store locations, multimedia content (for example example, pictures, video, sound or similar). The 336a company data store can be stored on one or more data storage devices. In another embodiment, the company computing system 300 can be coupled to a remote server or data storage device that includes at least some of the data in the company data repository 336a. Other data can be stored in the data storage component 336 to provide support for features described in this document.
[046] Still with reference to Figure 12, the memory component 340 includes company panel logic 341, company system integration logic 342, store integration logic 343, file transfer logic 344, company communications port logic 345 and operating logic 346. company panel logic 341 includes machine-readable instructions that, when executed by processor 330, cause the
Petition 870190105684, of 10/18/2019, p. 52/126
38/64 company computing 300 display a graphical user interface for managing the 336a company data repository. In some embodiments, the graphical user interface may make it possible to manage or adjust the data to be transmitted to the store's 400 computer system or to display one of the plurality of display units 118. In some embodiments, the user interface graphics can make it possible to control the content displayed in the plurality of display units 118. The company system integration logic 342 includes machine-readable instructions that, when executed by processor 330, cause the company computing system 300 to process events from from other company services. In some embodiments, company system integration logic 342 receives and handles planogram events, such as updating planograms. Store integration logic 343 includes machine-readable instructions that, when executed by processor 330, cause enterprise computing system 300 to transmit messages or data to store computing system 400 or receive messages or data from the system store computing speed 400. The file transfer logic 344 includes machine-readable instructions that, when executed by processor 330, cause the enterprise computing system 300 to transfer files, such as video or other media files, to the system. store computing 400. In some embodiments, the file transfer logic 344 includes an IBM MQ extension that facilitates the transfer of video files to the store computing system 400 so that the store computing system 400 makes the video files
Petition 870190105684, of 10/18/2019, p. 53/126
39/64 are displayed on at least one of the plurality of display units 118. Company communication port logic 345 includes machine-readable instructions that, when executed by processor 330, cause company computing system 300 to transmit messages or receive messages from the store computing system 400. In some embodiments, company communication port logic 345 can transmit and receive all messages to and from the store computing system 400, but it can forward or receiving only messages that belong to the plurality of display units 118 for store integration logic 343. Operating logic 346 may include an operating system and / or other software to manage components of the enterprise computing system 300.
[047] It should be understood that the components illustrated in Figure 12 are merely exemplary and are not intended to limit the scope of this disclosure. More specifically, although the components in Figure 12 are illustrated as residing within the enterprise computing system 300, this is a non-limiting example. In some embodiments, one or more of the components may reside outside the company's 300 computer system.
[048] Figure 13 represents additional details in relation to the store computing system 400 of Figure 10. In some embodiments, the store computing system 400 can be configured as a general purpose computer with hardware, software and / or requested firmware. In some embodiments, the 400 store computing system can be configured as a special purpose computer designed specifically to perform functionality
Petition 870190105684, of 10/18/2019, p. 54/126
40/64 described in this document.
[049] As shown in Figure 13, the store computing system 400 includes a processor 430, an input / output hardware 432, a network interface hardware 434, a data storage component 436 and a non-memory component transient 440. Memory component 440 can be configured as a computer-readable volatile and / or non-volatile medium and, as such, may include random access memory (including SRAM, DRAM and / or other types of random access memory), flash memory, records, compact discs (CD), digital versatile discs (DVD) and / or other types of storage components. Additionally, memory component 440 can be configured to store price manager logic 441, company integration logic 442, resource server logic 443, shelf integration logic 444, RAD integration logic 445, panel logic store 446, PAL integration logic 447, collector logic 448, file transfer logic 449, store communication port logic 450 and operational logic 451 (each of which can be incorporated as a computer program, firmware or hardware, as an example). A local interface 460 is also included in Figure 4 and can be implemented as a bus or other interface to facilitate communication between the components of the store computing system 400.
[050] Still referring to Figure 13, processor 430 can include any processing component configured to receive and execute instructions (such as from data storage component 436 and / or memory component 440). The 432 input / output hardware
Petition 870190105684, of 10/18/2019, p. 55/126
41/64 may include a monitor, keyboard, mouse, printer, camera, microphone, speaker, touch screen and / or other device for receiving, sending and / or presenting data. The network interface hardware 434 can include any wired and wireless network hardware, such as a modem, a LAN port, a wireless loyalty card (Wi-Fi), a WiMax card, mobile communications hardware and / or other hardware to communicate with other networks (for example, company computing network 215 or store computing network 225) and / or devices.
[051] The data storage component 436 can reside local and / or remote in relation to the store computing system 400 and can be configured to store one or more pieces of data for access by the store computing system 400 and / or other components. As shown in Figure 4, data storage component 436 can store a store data repository 436a, which can include inventory quantities that belong to products on the shelves, product dimension information, product weight information, product data product pertaining to products to be sold in the store, price data pertaining to products to be sold in the store, planogram data pertaining to product placement on shelves in the store, and label data to be displayed on display units in store shelf, multimedia content (for example, pictures, video or similar). The store data repository 436a can be stored on one or more data storage devices. In another embodiment, the 400 store computing system can be
Petition 870190105684, of 10/18/2019, p. 56/126
42/64 coupled to a remote server or data storage device that includes at least some of the data in the store data repository 436a. Other data can be stored in the data storage component 436 to provide support for features described in this document.
[052] Still referring to Figure 13, memory component 440 includes price manager logic 441, company integration logic 442, resource server logic 443, shelf integration logic 444, logic 445 integration logic, 446 store panel logic, PAL 447 integration logic, collector logic 448, file transfer logic 449, store communication port logic 450 and 451 operational logic Collector logic 448 includes machine-readable instructions that, when executed by the 430 processor, cause the store computing system 400 to collect data from numerous resources (for example, inventory quantities, price data, point information sales, label information, etc.) and transmit electronic shelf label events to the price manager logic. The price manager 441 logic includes machine-readable instructions that, when executed by the 430 processor, cause the store 400 computer system to process the electronic shelf label events transmitted by the 448 collector logic. The company integration logic 442 includes machine-readable instructions that, when executed by the 430 processor, cause the store computing system 400 to transmit messages or data to the enterprise computing system 300 or receive messages or data to
Petition 870190105684, of 10/18/2019, p. 57/126
43/64 from the enterprise computing system 300. Resource server logic 443 includes machine-readable instructions that, when executed by the 430 processor, cause the store 400 computing system to render image or video data as tags , banner ads, label template or video content to be displayed on the plurality of display units 118. Shelf integration logic 444 sends messages or content to the plurality of display units 118 to display by the plurality of display units 118 In some embodiments, the shelf integration logic 444 can be external to the store computing system 400. The integration logic of RAD 445 includes machine-readable instructions that, when executed by the 430 processor, make the computing system of store 400 receives messages and sends messages to the device associated with reseller 230. Store panel logic 446 includes machine-readable instructions which, when executed by the 430 processor, causes the store computing system 400 to display a graphical user interface for managing the store data repository 436a. In some embodiments, the graphical user interface may make it possible to manage or adjust the data or to display one of the plurality of display units 118. In some embodiments, the graphical user interface may make it possible to control the content displayed in the plurality of display units 118. The PAL 447 integration logic includes machine-readable instructions that, when executed by the 430 processor, make the store 400 computer system receive messages and transmit messages to the personal assistant and the
Petition 870190105684, of 10/18/2019, p. 58/126
44/64 connection device 240. The file transfer logic 449 includes machine-readable instructions that, when executed by the 430 processor, cause the store computing system 400 to receive files, such as video or other multimedia files from the enterprise computing system 300. In some embodiments, the file transfer logic 449 includes an IBM MQ extension that facilitates the transfer of video files to the store computing system 400. The store communication port logic 450 includes machine-readable instructions that, when executed by the 430 processor, cause the store computing system 400 to transmit messages or receive messages from the company computing system 300. In some embodiments, store communication port logic 450 can transmit and receive all messages to and from company 300 computer system, but can forward or receive only messages that belong 100 to the plurality of display units 118 for company integration logic 442. Operating logic 451 may include an operating system and / or other software for managing store computing system components 400.
[053] It should be understood that the components illustrated in Figure 13 are merely exemplary and are not intended to limit the scope of this disclosure. More specifically, although the components in Figure 8 are illustrated as residing within the 400 store computing system, this is a non-limiting example. In some embodiments, one or more of the components may reside outside the 400 store computer system.
Petition 870190105684, of 10/18/2019, p. 59/126
45/64 [054] Figure 14 graphically illustrates a method 1400 for determining whether orifice 104 on the top surface 102 of shelf 101 is blocked from light. In step 1410, camera 320 in shadow box 310 captures an image of the end surfaces 212 of the plurality of fiber optic filaments 108. For example, as shown in Figure 15, support 210 exposing the plurality of end surfaces 212 is captured by camera 320. The captured image is transmitted to the store 400 computer system via the 1000 computer network.
[055] In step 1420, processor 430 of store computing system 400 processes the captured image to obtain pixel values corresponding to each of the end surfaces 212 of the plurality of optical fiber filaments 108. Processor 430 can determine the brightness of each of the end surfaces 212 of the plurality of optical fiber filaments 108 and converting the brightness to a pixel value. For example, a table 1510 in Figure 15 includes pixel values that correspond to terminal surfaces 212, respectively. In another embodiment, a camera 320 processor can process the capture image to obtain pixel values and transmit the pixel values to the 400 store computer system. The pixel value can be one of several visual characteristics, for example, an optical intensity, a color spectrum or light density.
[056] In step 1430, processor 430 determines whether the pixel value is greater than a threshold value. The threshold value can be a predefined value. For example, the threshold value can be 10 and the pixel values in table 1510
Petition 870190105684, of 10/18/2019, p. 60/126
46/64 are compared with the threshold value 10. In some embodiments, the threshold value can be calculated based on the pixel values obtained in step 1420. For example, the threshold value can be an average value of the highest value pixel (for example, 23 in table 1510) and the lowest pixel value (zero in table 1510).
[057] If the pixel value is greater than the threshold value, in step 1440, processor 430 determines that the orifice 104 associated with the pixel value is not blocked by a light product. For example, twenty pixel values 1512 on the right side of table 1510 are greater than the threshold value (for example, 10) and therefore processor 430 determines that the set of holes 1530 on shelf 101 is not blocked as illustrated in Figure 15.
[058] If the pixel value is not greater than the threshold value, in step 1450, processor 430 determines that the orifice 104 associated with the pixel value is blocked by a light product. For example, twenty pixel values 1514 on the left side of table 1510 are less than the threshold value (for example, 10) and therefore processor 430 determines that the set of holes 1520 on shelf 101 is blocked as shown in Figure 15.
[059] Referring now to Figure 16, a flow chart that graphically illustrates a method 1600 for determining the number of products (that is, stock quantities) on shelf 101. In step 1610, camera 320 in shadow box 310 captures a image of the terminal surfaces 212 of the plurality of optical fiber filaments 108. The captured image is transmitted to the store computing system 400 through the computing network 1000.
Petition 870190105684, of 10/18/2019, p. 61/126
47/64 [060] In step 1620, processor 430 of store computing system 400 processes the captured image to determine which holes in shelf 101 are blocked from light. Details for determining whether an orifice 104 is blocked from light are described above with reference to Figures 14 and 15.
[061] In step 1630, processor 430 of store computing system 400 retrieves product information from shelf 101 based on the planogram stored in store data repository 436a. The processor 430 of the store computing system 400 can retrieve dimension information (e.g., width, length and height) about the products of the planogram stored in store data repository 436a. In some embodiments, the processor 430 of the store computing system 400 can also retrieve weight information about products based on the planogram.
[062] In step 1640, processor 430 of the store computing system 400 determines the number of products on the shelf based on the size of the product and the number of blocked holes. The 430 processor determines the bottom area of the product when placed on a shelf 101 based on the size of the product. In one embodiment, a product 1710 is placed on shelf 101 as shown in Figure 17A. Processor 430 determines the bottom SI area for product 1710 based on the size of product 1710 that is stored in storage data repository 436a. Then, processor 430 of store computing system 400 determines the average number of holes 104 being blocked by the SI area. For example, the average number of
Petition 870190105684, of 10/18/2019, p. 62/126
48/64 holes 104 being blocked by the SI area is four, as illustrated in Figure 17B. The average number of holes blocked by the SI area can be pre-stored in the storage data repository 436a and the processor can retrieve the pre-stored number related to product 1710. Then, processor 430 determines the number of products on shelf 101 by comparing the average number of holes blocked by a product with the number of blocked holes determined in step 1620. For example, if the number of blocked holes determined in step 1620 is twenty-four (24) and the average number of holes blocked by the SI area is four (4), the 430 processor can determine that six 1710 products are placed on shelf 101, as long as one 1710 product is not stacked on top of another 1710 product. Whether a product is stacked on top of another product can be determined by the second 530 camera in Figure 5A, which will be described below with reference to Figure 18.
[063] In another embodiment, a 1720 product is placed on shelf 101 as shown in Figure 17C. The 1720 product has a cylindrical shape. Processor 430 determines the bottom area S2 of product 1720 based on the dimension of product 1720 that is stored in storage data repository 436a. Then, processor 430 of store computing system 400 determines the average number of holes 104 being blocked by area S2. For example, the average number of holes 104 being blocked by area S2 is two (2), as illustrated in Figure 17D. The average number of holes blocked by the S2 area can be pre-stored in the 436a storage data repository and the processor
Petition 870190105684, of 10/18/2019, p. 63/126
49/64 can retrieve the pre-stored number related to product 1720. Then, processor 430 determines the number of products on shelf 101 by comparing the average number of holes blocked by a product with the number of blocked holes determined in step 1620. For For example, if the number of blocked holes determined in step 1620 is eighteen (18) and the average number of blocked holes in area S2 is two (2), processor 430 may determine that nine 1720 products are placed on shelf 101, provided that a 1720 product is not stacked on top of another 1720 product. The 430 processor of the 400 store computing system can update planogram data based on the number of products on the shelves.
[064] Referring now to Figure 18, a flowchart that graphically illustrates a method 1800 for determining the number of products (ie stock quantities) on shelf 101. In step 1810, camera 320 in shadow box 310 captures a image of the terminal surfaces 212 of the plurality of optical fiber filaments 108. The captured image is transmitted to the store computing system 400 through the computing network 1000.
[065] In step 1820, processor 430 of store computing system 400 processes the captured image to determine which holes in shelf 101 are blocked from light. Details for determining whether an orifice 104 is blocked from light are described above with reference to Figures 14 and 15.
[066] In step 1830, processor 430 of the store computing system 400 retrieves product information on shelf 101 of the planogram stored in the store repository.
Petition 870190105684, of 10/18/2019, p. 64/126
50/64 store data 436a. The processor 430 of the store computing system 400 can retrieve dimension information (e.g., width, length and height) about the products based on the planogram. In some embodiments, the processor 430 of the store computing system 400 can also retrieve weight information about products based on the planogram.
[067] In step 1840, the second camera 530 captures an image of one side of products on shelf 101, for example, the image as illustrated in Figure 5C. The second camera 530 can transmit the captured image to the store computing system 400 over the computing network 1000.
[068] In step 1850, processor 430 of the store computing system 400 processes the captured image from the second camera 530 to determine whether a product is stacked on top of another product. For example, processor 430 can process the captured image 1910 in Figure 19 and determine that no product is stacked on top of another product. In another example, processor 430 can process the captured image 1920 in Figure 19, and determines that some products are stacked on top of other products and at least two layers of products are present on shelf 101. In another example, processor 430 can process the image. captured image 1930, as shown in Figure 19, and determines that some products are stacked on top of other products and at least three layers of products are present on shelf 101. In some embodiment, the processor 430 of the store computing system 400 can process the capture image from the second 530 camera to determine product information, for example, what the product is, the product size, etc. In another
Petition 870190105684, of 10/18/2019, p. 65/126
51/64 mode, the second camera 530 can process the capture image to determine product information and transmit the product information to the store 400 computer system.
[069] In step 1860, processor 430 of store computing system 400 determines the number of products on shelf 101 based on the size of the product, the number of holes 104 being blocked and the image captured on the side of products on shelf 101 The 430 processor determines the bottom area of the product when placed on the shelf based on the size of the product. In one embodiment, a product 1710 is placed on shelf 101 in Figure 17A. Processor 430 determines the bottom area Sl for product 1710 based on the dimension of product 1710 that is stored in storage data repository 436a. Then, processor 430 of the store computing system 400 determines the average number of holes 104 being blocked by the area Sl. For example, the average number of holes 104 being blocked by the area Sl is four, as illustrated in Figure 17B. The average number of holes blocked by the Sl area can be pre-stored in the storage data repository 436a and the processor can retrieve the pre-stored number related to product 1710. Then processor 430 determines the number of products on shelf 101 by comparing the average number of holes blocked by a product with the number of blocked holes determined in step 1820. For example, if the number of blocked holes determined in step 1820 is twenty-four (24) and the average number of holes blocked by area Sl is four (4), the 430 processor can determine that at least six
Petition 870190105684, of 10/18/2019, p. 66/126
52/64 1710 products are placed on shelf 101. If the stacking information determined in step 1850 provides that no 1710 product is stacked on top of another 1710 product, processor 430 confirms that six 1710 products are placed on shelf 101. If the stacking determined in step 1850 provide that two layers of 1710 products are present on shelf 101, similar to the image captured 1920 in Figure 19, processor 430 can determine that the number of 1710 products is between 7 and 12. If the determined stacking information in step 1850, three layers of 1710 products are expected to be present on the shelf similar to the image captured in 1930, the 430 processor can determine that the number of 1710 products is between 13 and 18. In some embodiments, weight information about products on the shelf 101 that are obtained by weight sensor 107 in Figure 2A can be used to determine the exact number of products 1710 co m based on weight information per product that is stored in the store data repository 436a. The processor 430 of the store computing system 400 can update the planogram data based on the number of products on the shelves.
[070] Referring now to Figure 20, a flowchart that graphically illustrates a method 2000 for determining an orientation of a product placed on shelf 101. In step 2010, camera 320 in shadow box 310 captures an image of the terminal surfaces 212 of the plurality of optical fiber filaments 108. The captured image is transmitted to the store computing system 400 through the computing network 1000.
Petition 870190105684, of 10/18/2019, p. 67/126
53/64 [071] In step 2020, processor 430 of the store computing system 400 processes the captured image to determine a pattern of holes being blocked from light. Details for determining whether an orifice 104 is blocked from light are described above with reference to Figures 14 and 15.
[072] In step 2030, processor 430 of store computing system 400 retrieves product information from shelf 101 of the planogram stored in store data repository 436a. The processor 430 of the store computing system 400 can retrieve dimension information (e.g., width, length and height) about the products based on the planogram.
[073] In step 2040, processor 430 of the store computing system 400 determines an orientation of a product placed on the shelf based on the size of the product and a pattern of holes being blocked. For example, in Figure 21A, a set of end surfaces 2110 is relatively dark compared to other end surfaces 212. The store computer system 400 determines that the holes 104 corresponding to the set of end surfaces 2110 are blocked from light. Based on the pattern of holes 104 being blocked, the store computing system 400 determines that a product 2140 is placed obliquely on shelf 101 from the perspective of a customer 2150, as shown in Figure 21A. When a product is placed obliquely on shelf 101, the store 400 computing system can alert an employee by sending a message to an associated retail device 230 or a mobile computing device.
Petition 870190105684, of 10/18/2019, p. 68/126
54/64
250 that the product on shelf 101 needs to be organized (for example, re-facing). For example, an employee may receive a message to bring products to the front of the shelf for the cost of the presentation, which allows customers to easily access products on the high or low shelves. In addition, store computer system 400 can instruct light source 322 to light up so that holes 104 on the top surface 102 of shelf 101 are illuminated to alert employees to shelf 101. In some embodiments, the processor 430 of the store computing system 400 can determine the location of product placement on shelf 101 based on the size of the product and a pattern of holes being blocked. The processor 430 of the store computing system 400 can update the planogram data based on the orientation of products on the shelves.
[074] As another example, in Figure 21B, a set of end surfaces 2120 is relatively dark compared to other end surfaces 212. The store computing system 400 determines that the holes 104 corresponding to the set of end surfaces 2120 are blocked from light. Based on the pattern of holes 104 being blocked, the store computing system 400 determines that product 2140 is placed on shelf 101 with a top surface 2124 facing a customer 2150, as shown in Figure 21B. As another example, in Figure 21C, a set of end surfaces 2130 is relatively dark compared to other end surfaces 212. The store computing system 400 determines that the holes 104 corresponding to the set of
Petition 870190105684, of 10/18/2019, p. 69/126
55/64 terminal surfaces 2130 are blocked from light. Based on the pattern of holes 104 being blocked, the store computing system 400 determines that product 2140 is placed on shelf 101 with a side surface 2126 facing a customer 2150, as shown in Figure 21C.
[075] Referring now to Figure 22, a flow chart that graphically illustrates a 2200 method of indicating low stock or out of stock. In step 2210, camera 320 in shadow box 310 captures an image of the terminal surfaces 212 of the plurality of fiber optic filaments 108. The captured image is transmitted to the store computing system 400 over the computing network 1000.
[076] In step 2220, processor 430 of the store computing system 400 processes the captured image to determine which holes in shelf 101 are blocked from light. Details for determining whether an orifice 104 is blocked from light are described above with reference to Figures 14 and 15.
[077] In step 2230, processor 430 of store computing system 400 retrieves product information on shelf 101 of the planogram stored in store data repository 436a. The processor 430 of the store computing system 400 can retrieve dimension information (e.g., width, length and height) about the products based on the planogram. In some embodiments, the processor 430 of the store computing system 400 can also retrieve weight information about products based on the planogram.
[078] In step 2240, processor 430 of the store computing system 400 determines the number of products in the
Petition 870190105684, of 10/18/2019, p. 70/126
56/64 shelf 101 based on product size and number of blocked holes. Details of determining the number of products on shelf 101 are described above with reference to Figures 16 and 18.
[079] In step 2250, processor 430 of store computing system 400 turns on light source 322 in shadow box 310 to illuminate holes 104 on shelf 101 if the number of products on shelf 101 is less than a predetermined value . For example, if the default value is three and the number of products on shelf 101 is two, store computer system 400 determines that shelf 101 is low on stock and turns on the light source 322 associated with shelf 101. The source lighting 322 can emit a certain color of light in response to the determination that shelf 101 is low on stock. Store computing system 400 may change the display content of display unit 118 to shelf 101 in response to the determination that shelf 101 is low on stock. For example, store computing system 400 may increase the price displayed on display unit 118. As another example, store computing system 400 may instruct other display units 118 to display content that attracts customers in order to prevent customers from buying low-stock products. As another example, the store computing system 400 may instruct other display units 118 to lower the prices of products comparable to products with low stock. As another example, the store computing system 400 may send a message to an associated retail device 230 or a mobile computing device 250 that the
Petition 870190105684, of 10/18/2019, p. 71/126
57/64 shelf 101 needs to be replenished. As another example, store computing system 400 may send a message to a robot to restock products on shelf 101 in response to the determination that shelf 101 is low on stock. As another example, the store 400 computer system can update a product placement database with a note that shelf 101 is low on stock. As another example, the store computing system 400 may automatically trigger the reordering of the low stock product in a warehouse in response to the determination that the number of products on shelf 101 is less than a predetermined value.
[080] If the number of products on shelf 101 is zero, processor 430 of store computing system 400 determines that shelf 101 is out of stock and turns on the lighting source 322 associated with shelf 101 to alert store employees about Out of stock. For example, processor 430 of store computing system 400 instructs light source 322 to emit a certain color of light. As another example, processor 430 of store computing system 400 can instruct light source 322 to flash to alert store employees. The store computing system 400 may change the display content of display unit 118 to shelf 101 in response to the determination that shelf 101 is out of stock. For example, store computing system 400 may instruct display unit 118 to display out of stock. As another example, store computing system 400 can instruct other display units 118 to display content that attracts customers, so that customers
Petition 870190105684, of 10/18/2019, p. 72/126
58/64 buy alternatives to the product that is out of stock.
As another example, the store computing system 400 can send a message to an associated retail device 230 or a mobile computing device 250 that shelf 101 needs to be replenished. As another example, the store computing system 400 can send a message to a robot to restock products on shelf 101 in response to the determination that shelf 101 is out of stock. As another example, the store 400 computer system can update a product placement database with a note that shelf 101 is out of stock.
As another example, the store computing system 400 can automatically trigger the product order again from a warehouse in response to the determination that the number of products on shelf 101 is zero.
[081] Referring now to Figure 23, a flow chart that graphically illustrates a method 2300 for determining a period of time that a product has been on shelf 101. In step 2310, camera 320 in shadow box 310 captures an image of terminal surfaces 212 of the plurality of optical fiber filaments 108. The captured image is transmitted to the store computing system 400 through the computing network 1000.
[082] In step 2320, processor 430 of store computing system 400 processes the captured image to determine a period of time when the same holes are blocked from light. Details for determining whether an orifice 104 is blocked from light are described above with reference to Figures 14 and 15. The time period can be the number of days the same orifices are continuously
Petition 870190105684, of 10/18/2019, p. 73/126
59/64 blocked from light.
[083] In step 2330, processor 430 of store computing system 400 retrieves product information from shelf 101 of the planogram stored in store data repository 436a. The processor 430 of the store computing system 400 can retrieve dimension information (e.g., width, length and height) about the products based on the planogram.
[084] In step 2340, processor 430 of the store computing system 400 determines a period of time when products are on shelf 101 based on the period of time when the same holes are blocked from light and information about the product. For example, if the store computing system 400 determines that twenty holes 104 on shelf 101 are blocked for 10 days, and product information indicates that the average number of holes 104 blocked by a product on shelf 101 is four, then the 400 store computing system determines that five products have been on shelf 101 for 10 days.
[085] In step 2350, processor 430 of store computing system 400 changes the display content of display unit 118 to shelf 101 based on the time period determined in step 2340. For example, the computing system of store 400 can lower the price displayed on display unit 118 if the time period is longer than a predetermined period. As another example, the store computing system 400 may send a message to an associated retail device 230 or a mobile computing device 250 that products on shelf 101 need to be sold if the time period is longer than one
Petition 870190105684, of 10/18/2019, p. 74/126
60/64 predetermined period.
[086] Now, with reference to Figure 24, a flow chart that graphically illustrates a 2400 method of detecting theft activities. In step 2410, the camera 320 in the shadow box 310 captures an image of the terminal surfaces 212 of the plurality of optical fiber filaments 108. The captured image is transmitted to the store computing system 400 over the computing network 1000.
[087] In step 2420, processor 430 of store computing system 400 determines the number of holes 104 that are unlocked from the light during a predetermined time. The store computing system 400 can determine the number of holes that are unblocked from light during the predetermined time, by determining the number of end surfaces 212 whose brightness has changed substantially during the predetermined time. The predetermined time can be less than one minute, for example 20 seconds, 30 seconds, etc. The store computing system 400 can determine that the brightness of certain end surfaces 212 has changed substantially by referring to the change in pixel values on end surfaces 212, for example, as shown in Figure 15.
[088] In step 2430, processor 430 of store computing system 400 retrieves product information from shelf 101 of the planogram stored in store data repository 436a. Product information includes price information for the product. The processor 430 of the store computing system 400 can retrieve dimension information (for example, width, length and height) about the product based on the planogram.
Petition 870190105684, of 10/18/2019, p. 75/126
61/64 [089] In step 2440, processor 430 of the store computing system determines the number of products that are removed from shelf 101 during the predetermined time, based on the number of holes determined in step 2430 and information about the product. For example, if processor 430 of store computing system 400 determines that forty (40) holes 104 on shelf 101 have been unblocked from light during the predetermined time, and product information indicates that the average number of holes 104 blocked by the product on shelf 101 is four (4), so store computing system 400 determines that ten products have been removed from shelf 101 during the predetermined time.
[090] In step 2450, processor 430 of the store computing system 400 generates a potential theft alert based on the number of products that are removed from shelf 101 during a predetermined time and an expected product sales rate. The expected sale rate of the product can be retrieved from the store data repository 436a. For example, the processor 430 of the store computing system 400 can instruct the light source 322 to light up so that the holes 104 on the top surface 102 of the shelf 101 are illuminated. As another example, the store computing system 400 may send a message to an associated retail device 230 or a mobile computing device 250 that indicates possible theft. As another example, the store computing system 400 can instruct camera 320 to capture an image of a customer near shelf 101.
[091] Various other methods of managing
Petition 870190105684, of 10/18/2019, p. 76/126
62/64 store shelves can be deployed using the fiber optic shelf storage system. In one embodiment, the store computing system 400 can measure the productivity of the store based on information received from shelves 101. For example, the store computing system 400 can measure a period of time between the sending of a write-off alert on out of stock to employees and when shelf 101 is replenished by employees. The store computing system 400 can determine the time that shelf 101 is replenished by monitoring the image captured by camera 320 in shadow box 310. Based on the measured time period, the store computing system 400 can determine productivity of employees regarding refueling. The store computing system 400 can also measure a replenishment rate, as well as product rotation, by measuring the times when products are replenished.
[092] In another modality, the store 400 computer system can determine whether a customer takes a particular product off the shelf based on the image captured by camera 320, the product information associated with shelf 101 and / or the image captured by the second camera 530. The store computing system 400 can automatically add the product to the customer's shopping list, so that the customer does not need to scan the product at checkout. The store computing system 400 can also determine whether the customer places the product back on the shelf based on the image captured by camera 320, the product information associated with shelf 101 and / or the image captured by the second camera 530. The system in
Petition 870190105684, of 10/18/2019, p. 77/126
63/64 store computing 400 can also determine whether a retail associate picks a particular product off the shelf based on the image captured by camera 320, product information associated with shelf 101, and / or the image captured by the second camera 530.
[093] In another modality, the store 400 computer system can determine inventory changes for a product over a certain period of time, monitoring the images captured by camera 320 and comparing the inventory changes for the product with the sales values product for a certain period of time. If inventory changes are substantially different from the sales figures, the store 400 computer system can alert you to possible theft, product deterioration, etc.2018 [094] Now it should be understood that the systems described here can determine the number of products on store shelves using fiber optic filaments. These systems allow stores to accurately check inventory quantities in real time, check the displayed orientation of products on the shelves, facilitate the replenishment of products, determine which products are due to expire or deteriorate and prevent theft activities.
[095] It should be noted that the terms substantially and about can be used in this document to represent the inherent degree of uncertainty that can be attributed to any quantitative comparison, value, measurement or other representation. These terms are also used in this document to
Petition 870190105684, of 10/18/2019, p. 78/126
64/64 represent the degree to which a quantitative representation can vary from a declared reference without resulting in a change in the basic function of the subject in question.
[096] Although particular modalities have been illustrated and described in this document, it must be understood that several other changes and modifications can be made without departing from the spirit and scope of the claimed matter. Furthermore, although several aspects of the claimed matter have been described in this document, such aspects need not be used in combination. Therefore, it is intended that the attached claims cover all such changes and modifications that are within the scope of the claimed matter.

权利要求:
Claims (20)
[1]
AMENDED CLAIMS
1. Fiber optic shelf storage system, characterized by the fact that it comprises:
a shelf including a plurality of holes in an upper surface of the shelf;
a plurality of optical fiber filaments, each of the plurality of optical fiber filaments having a first end and a second end, and the first end being coupled to one of the plurality of holes;
a support configured to retain the second ends of the plurality of optical fiber filaments, the support exposing the end surfaces of the second ends of the plurality of optical fiber filaments;
a first camera configured to capture an image of the end surfaces of the second ends of the plurality of optical fiber filaments;
a second camera configured to capture an image of one side of one or more products on the shelf;
one or more processors communicatively coupled to the first camera and the second camera;
one or more memory components coupled communicatively to one or more processors; and machine-readable instructions stored in one or more memory components that, when executed by one or more processors, additionally cause the fiber optic shelf storage system to:
determine a number of products on the shelf based on the captured image of the end surfaces of the second ends of the plurality of fiber optic filaments and
Petition 870190105684, of 10/18/2019, p. 118/126
[2]
2/9 in the image captured on the side of one or more products on the shelf.
2. Fiber optic shelf storage system, according to claim 1, characterized by the fact that determining the number of products on the shelf comprises:
determining how many holes in the plurality of holes are blocked from light based on the captured image of terminal surfaces of the second ends of the plurality of optical fiber filaments; and determining the number of products on the shelf based on the number of blocked light holes and the image captured on the side of one or more products on the shelf.
[3]
3. Fiber optic shelf storage system according to claim 1, characterized by the fact that machine-readable instructions stored in one or more memory components additionally cause the optical fiber shelf storage system to:
determining a product orientation on the shelf based on the captured image of the terminal surfaces of the second ends of the plurality of optical fiber filaments.
[4]
4. Fiber optic shelf storage system, according to claim 1, characterized by the fact that it also comprises a light coupled to a lower shelf surface.
[5]
5. Fiber optic shelf storage system, according to claim 1, characterized by the fact that the one or more memory components include planogram information for the shelf.
Petition 870190105684, of 10/18/2019, p. 119/126
3/9
[6]
6. Fiber optic shelf storage system, according to claim 5, characterized by the fact that determining the number of products on the shelf comprises:
determine the number of products on the shelf based on the captured image of the terminal surfaces of the second ends of the plurality of fiber optic filaments and the planogram information for the shelf.
[7]
7. Fiber optic shelf storage system, according to claim 5, characterized by the fact that determining the number of products on the shelf comprises:
determine the number of products on the shelf based on the image captured from the end surfaces of the second ends of the fiber optic filaments, the image captured from the side of one or more products on the shelf and the planogram information for the shelf.
[8]
8. Fiber optic shelf storage system, according to claim 1, characterized by the fact that it further comprises a lighting source configured to illuminate the end surfaces of the second ends of the plurality of optical fiber filaments.
[9]
9. Fiber optic shelf storage system, according to claim 1, characterized by the fact that it also comprises a shadow box having an opening, in which the support is configured to be inserted in the opening and the first camera is located inside the shadow box.
Petition 870190105684, of 10/18/2019, p. 120/126
4/9
[10]
10. Fiber optic shelf storage system, according to claim 1, characterized by the fact that it also comprises:
a display unit attached to one end of the shelf.
[11]
11. Fiber optic shelf storage system, according to claim 10, characterized by the fact that it also comprises an optical element attached to a lower shelf surface, in which the optical element is configured to direct the light from the display towards an upper surface of another shelf.
[12]
12. Fiber optic shelf storage system according to claim 8, characterized by the fact that machine-readable instructions stored in one or more memory components additionally cause the optical fiber shelf storage system to:
determine if a number of products on the shelf is less than a predetermined value; and turn on the light to illuminate the end surfaces of the second ends of the fiber optic filaments, if the number of products on the shelf is less than the predetermined value.
[13]
13. Fiber optic shelf storage system according to claim 1, characterized by the fact that machine-readable instructions stored in one or more memory components additionally cause the optical fiber shelf storage system to:
determine a number of orifices that have been unlocked from the light during a predetermined time;
Petition 870190105684, of 10/18/2019, p. 121/126
5/9 retrieve product information from the shelf;
determining the number of products that are removed from the shelf during the predetermined time based on the number of holes that were unlocked from the light during the predetermined time and on the product information; and generate a potential theft alert based on the number of products taken off the shelf during the predetermined time and product price.
[14]
14. Fiber optic shelf storage system according to claim 1, characterized by the fact that machine-readable instructions stored in one or more memory components additionally cause the optical fiber shelf storage system to:
determining the locations of the products on the shelf based on the image captured from the end surfaces of the second ends of the plurality of optical fiber filaments and the image captured from the side of one or more products on the shelf.
[15]
15. Fiber optic shelf storage system, characterized by the fact that it comprises:
a first shelf including a first set of holes in the top surface of the first shelf;
a second shelf including a second set of holes in the upper surface of the second shelf;
a first set of optical fiber filaments having first and second ends, each of the first ends of the first set of optical fiber filaments being coupled to one of the first set of holes;
a second set of optical fiber filaments
Petition 870190105684, of 10/18/2019, p. 122/126
6/9 having first and second ends, each of the first ends of the second set of optical fiber filaments being coupled to one of the second set of holes;
a first support configured to retain the second ends of the first fiber optic filament set, the first support exposing the end surfaces of the second ends of the first fiber optic filament set;
a second support configured to retain the second ends of the second set of optical fiber strands, the second support exposing the end surfaces of the second ends of the second set of optical fiber strands;
a shadow box including a plurality of openings, each of the plurality of openings being configured to receive a support;
a first camera within the shadow box, the first camera configured to capture an image of the end surfaces of the second ends of the first set of fiber optic strands and the end surfaces of the second ends of the second set of fiber optic strands;
one or more processors communicatively coupled to the first camera;
one or more memory components coupled communicatively to one or more processors; and machine-readable instructions stored in one or more memory components that, when executed by one or more processors, additionally cause the
Petition 870190105684, of 10/18/2019, p. 123/126
7/9 fiber optic shelf storage a:
determine a number of products on the first shelf and a number of products on the second shelf based on the captured image of the end surfaces of the second ends of the first fiber optic strand and the end surfaces of the second ends of the second fiber optic strand .
[16]
16. Fiber optic shelf storage system, according to claim 15, characterized by the fact that it also comprises:
a second camera configured to capture an image of one side of one or more products on the first shelf and one or more products on the second shelf.
[17]
17. Fiber optic shelf storage system according to claim 16, characterized by the fact that determining the number of products on the first shelf and a number of products on the second shelf comprises:
determine how the holes in the plurality of holes in the first shelf and the second shelf are blocked from light based on the image captured from the end surfaces of the second ends of the first set of fiber optic filaments and the image captured from the end surfaces of the second ends of the second set of optical fiber filaments; and determining the number of products on the first shelf and the second shelf based on the number of holes in the first shelf and the second shelf blocked from the light and image captured on the side of one or more products on the first shelf and the second shelf.
Petition 870190105684, of 10/18/2019, p. 124/126
8/9
[18]
18. Fiber optic shelf storage system according to claim 15, characterized by the fact that machine-readable instructions stored in one or more memory components additionally cause the optical fiber shelf storage system to:
determine product locations on the first shelf and product locations on the second shelf based on the captured image of the end surfaces of the second ends of the first set of optical fiber filaments and the end surfaces of the second ends of the second set of optical fiber filaments.
[19]
19. Fiber optic shelf storage system, characterized by the fact that it comprises:
a shelf including a plurality of holes in an upper surface of the shelf;
a plurality of caps integrated into the plurality of holes;
a plurality of optical fiber filaments, each of the plurality of optical fiber filaments having a first end and a second end, and the first end being detachably coupled to one of the plurality of caps;
a support configured to retain the second ends of the plurality of optical fiber filaments, the support exposing the end surfaces of the second ends of the plurality of optical fiber filaments;
a first camera configured to capture an image of the end surfaces of the second ends of the plurality of optical fiber filaments;
Petition 870190105684, of 10/18/2019, p. 125/126
9/9 one or more processors connected communicatively to the first camera;
one or more memory components coupled communicatively to one or more processors; and machine-readable instructions stored in one or more memory components that, when executed by one or more processors, additionally cause the fiber optic shelf storage system to:
determining a number of products on the shelf based on the captured image of the terminal surfaces of the second ends of the plurality of optical fiber filaments.
[20]
20. Fiber optic shelf storage system, according to claim 19, characterized by the fact that it also comprises a second camera configured to capture an image of one side of one or more products on the shelf.

类似技术:

---

公开号 | 公开日 | 专利标题

---

BR112019021966A2|2020-05-05|fiber optic shelf storage system

---

RU2722857C2|2020-06-04|Systems and methods for controlling display shelf units and for graphically displaying information on display shelf units

---

US20170124603A1|2017-05-04|Marketing display systems and methods

---

US10565549B2|2020-02-18|System and method for managing retail products

---

US8429004B2|2013-04-23|Method and system for automatically measuring retail store display compliance

---

US20160104141A1|2016-04-14|System for an automated dispensing and retrieval kiosk for recorded media

---

US10882692B1|2021-01-05|Item replacement assistance

---

CN104135898A|2014-11-05|Display shelf modules with projectors for displaying product information and modular shelving systems comprising the same

---

KR20200019685A|2020-02-24|Systems and methods that facilitate parcel pickup

---

US10489742B2|2019-11-26|System and method for managing retail products

---

JP2011100316A|2011-05-19|Display apparatus, method of controlling display apparatus, and display control program

---

KR20210079965A|2021-06-30|Method for managing inventory and product sales using smart shelves and smart shelves for inventory management and product sales

---

US20180053247A1|2018-02-22|Produce selection system for bulk items

---

US20210279784A1|2021-09-09|Analysis method and system for the item on the supermarket shelf

---

US10582150B2|2020-03-03|Audio/visual recording apparatus, audio/visual recording and playback system and methods for the same

---

US20200118078A1|2020-04-16|Systems, Method and Apparatus for Automated and Intelligent Inventory Stocking

---

JP2021080087A|2021-05-27|Information processing system, information processing device, information processing program, and information processing method

---

KAUR2019|STORE INVENTORY OPERATIONS CLOUD SERVICES | Project Report

---

US20150348176A1|2015-12-03|System and method for selling lamps

同族专利:

---

公开号 | 公开日

---

US20200116914A1|2020-04-16|

---

CA3058673A1|2018-10-25|

---

US10534122B2|2020-01-14|

---

CN110536625A|2019-12-03|

---

KR102231143B1|2021-03-24|

---

AU2018254439A1|2019-10-24|

---

US10989856B2|2021-04-27|

---

EP3612058B1|2021-02-24|

---

US20180306958A1|2018-10-25|

---

RU2729789C1|2020-08-17|

---

KR20190137855A|2019-12-11|

---

WO2018195172A1|2018-10-25|

---

EP3612058A1|2020-02-26|

---

JP2020520255A|2020-07-09|

---

AU2018254439B2|2020-08-27|

引用文献:

---

公开号 | 申请日 | 公开日 | 申请人 | 专利标题

---

---

US4095872A|1977-01-13|1978-06-20|The United States Of America As Represented By The Secretary Of The Army|Security sealing system using fiber optics|

---

DE9407032U1|1994-04-28|1994-07-21|Bierfreund Wolfgang|shelf|

---

US6104371A|1997-03-10|2000-08-15|Nec Research Institute, Inc.|Modular, high-intensity fiber optic backlight for color displays|

---

DE20302431U1|2003-02-14|2003-04-24|Linde Ag|Illuminated display unit has array of point light sources in a base or a wall section|

---

US20050279722A1|2003-08-22|2005-12-22|Ala Ali|Multiple station inventory control system|

---

AU2005307767A1|2004-11-19|2006-05-26|Goliath Solutions L.L.C.|Low stock alert system|

---

US9821344B2|2004-12-10|2017-11-21|Ikan Holdings Llc|Systems and methods for scanning information from storage area contents|

---

US7693757B2|2006-09-21|2010-04-06|International Business Machines Corporation|System and method for performing inventory using a mobile inventory robot|

---

US8091782B2|2007-11-08|2012-01-10|International Business Machines Corporation|Using cameras to monitor actual inventory|

---

US8321304B2|2008-08-06|2012-11-27|Ferveo Technology|Stocked product sensing system|

---

US9041508B2|2008-08-08|2015-05-26|Snap-On Incorporated|Image-based inventory control system and method|

---

US9147174B2|2008-08-08|2015-09-29|Snap-On Incorporated|Image-based inventory control system using advanced image recognition|

---

SG177797A1|2010-07-27|2012-02-28|Trika S Pte Ltd|Apparatus with embedded light guiding element and methods of manufacturing the same|

---

RU116031U1|2012-02-22|2012-05-20|Общество с ограниченной ответственностью "АРГОН"|SHOWCASE|

---

RU130488U1|2013-03-12|2013-07-27|Олег Львович Котлер|SHOW-SHOP FOR PRODUCT DISPLAY|

---

GB201419733D0|2014-11-05|2014-12-17|Elstat Electronics Ltd|Light sheild|

---

MX2017008126A|2014-12-19|2017-10-18|Elstat Ltd|Method for maintenance of a vending machine.|

---

BR112017023743A2|2015-05-04|2018-07-31|Sunrise R&D Holdings, Llc|systems and methods for controlling shelf display units and for graphically displaying information on shelf display units.|DE102015120000A1|2015-11-18|2017-05-18|Würth Elektronik Ics Gmbh & Co. Kg|Sensor assembly, sensor system and storage device|

---

CN109643266A|2016-08-31|2019-04-16|康普技术有限责任公司|For monitoring the existing system and method for the equipment installed in rack|

---

WO2018204342A1|2017-05-01|2018-11-08|Symbol Technologies, Llc|Product status detection system|

---

JP6783739B2|2017-10-31|2020-11-11|株式会社東芝|Inspection system and inspection method|

---

US11090811B2|2018-11-13|2021-08-17|Zebra Technologies Corporation|Method and apparatus for labeling of support structures|

---

US10891586B1|2018-11-23|2021-01-12|Smart Supervision System LLC|Systems and methods of detecting, identifying and classifying objects positioned on a surface|

---

US11079240B2|2018-12-07|2021-08-03|Zebra Technologies Corporation|Method, system and apparatus for adaptive particle filter localization|

---

US11151743B2|2019-06-03|2021-10-19|Zebra Technologies Corporation|Method, system and apparatus for end of aisle detection|

---

US11080566B2|2019-06-03|2021-08-03|Zebra Technologies Corporation|Method, system and apparatus for gap detection in support structures with peg regions|

---

US11107238B2|2019-12-13|2021-08-31|Zebra Technologies Corporation|Method, system and apparatus for detecting item facings|

---

CN111314588B|2020-02-21|2021-07-16|联想有限公司|Intelligent retail cabinet and commodity exhibition and sale platform|

法律状态:
2021-10-19| B350| Update of information on the portal [chapter 15.35 patent gazette]|

---

2022-02-08| B08F| Application dismissed because of non-payment of annual fees [chapter 8.6 patent gazette]|Free format text: REFERENTE A 4A ANUIDADE. |

优先权:

---

申请号 | 申请日 | 专利标题

---

US15/491,096|US10534122B2|2017-04-19|2017-04-19|Fiber optic shelving system|

---

PCT/US2018/028123|WO2018195172A1|2017-04-19|2018-04-18|Fiber optic shelving system|

---